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MT^rHANISM FOR ArrEfiSTWfi' piGT TTZKD IMAGE DATABASE TO 
PROVIDE ITEPATTVEL V IMPROVED DTSPI.AY RESOLUTION 

ETET.D OF THR INV ENTION 

5 The present invention relates in general to 

digitized image data processing systems and -is 
particularly directed to a mechanism for accessing the 
contents of a two-dimensional image- representative 
database and rapidly displaying an image the resolution 
10 of which is iteratively increased during successive 
scans of the database. 

F&rKCIPOTTND Q V THE INVENTION 

Digital imaging systems, such as those 

15 employed for converting still color photographic slides 
into a digital format for display on a color television 
monitor, customarily encode the output of an electronic 
imaging device, such as a digital color camera, to some 
prescribed resolution and store the encoded image in an 

20 associated database as a respective image file on a 

digital storage medium. When it is desired to display 
a particular stored image, the contents of the 
respective addresses of the database in which the 
digitized image has been stored are read out and 

25 coupled to display driver circuitry for energizing 
corresponding pixels of a display device. 

With continuing improvements in digital 
storage media density and recording technology, it has 
been possible to increase both the image capacity and 

30 resolution of the digital database, so that the image 
quality produced from the image database, by means of a 
high resolution output device, such as a high 
definition color display or high resolution thermal 
printer, is substantially indistinguishable from the 

35 quality produced by directly linking the digital color 
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camera to the output device. Unfortunately, coupling 
the stored image in the database to the output device 
cannot take place instantaneously; the contents of the 
respective addresses of the database must be clocked 
5 out to the corresponding pixels of the display. Even 
with the improved operational speed of present day 
digital storage media, there is some finite access time 
associated with each digital byte of information used 
to represent the image, so that as the size of the 

10 image array is increased in order to provide a higher 

resolution output image, the length of time required to 
access the entire image necessarily increases. As a 
consequence, in applications where the data rate of the 
digital storage device is fixed at a relatively 

15 moderate speed, for example at the 167.4 kbytes/sec 
rate of current compact disc players, an individual 
desiring to view a stored high resolution image, for 
example a 2048 X 3072 <2K by 3K) pixel array, must wait 
while a read-out clock that is compatible with the 

20 operational speed of the digital storage device (CD 

player) calls up from memory, each of the data entries 
associated with the respective pixels of the image. 
Obviously, the higher the image resolution, the longer 
it takes for the image to be displayed. Thus, should 

25 the viewer wish to "electronically thumb through" a 
- "P 1 ura 1 4rty-o f images or -ev 

the disc, the slow access time constitutes a major 
hindrance to that effort, which is particularly 
objectionable due to the extremely fast response time 

30 of the human visual system. 

In accordance with the present invention, the 
considerable "viewing delay" encountered in accessing a 
digital image from a relatively high resolution 
database using a conventional sequential data access 

35 scheme is substantially reduced by a readout and 
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di splay control mechanism that rapidly provides the 
viewer with an initially relatively low resolution 
image and thereafter automatically increases the 
resolution of the displayed image. By presenting the 
5 viewer with such a 'quick-view- image, the present 

invention enables the viewer to determine whether the 
image being displayed is of interest, so that the 
viewer has the immediate option of calling up another 
stored image or permitting the currently displayed low 
10 resolution image to be iteratively enhanced. 

To this end the present invention 
incorporates a memory addressing mechanism through 
which first partitioned data entries of the image 
database, which are respectively associated with a two- 
15 dimensional sub-array of R X S picture elements of the 
image and the spatial resolution of which is less than 
that of the M X N picture elements of the display, are 
sequentially accessed at the transfer rate of the 
digital storage device (e.g. the above- referenced 167.4 
2Q kbytes/sec rate of a compact disc player) and stored in 
a corresponding sub-array of R X S pixels in the 
playback device. Because, the size of the R X S sub- 
array is a fraction (e.g. one-fourth) of the M X N 
picture elements of the display, it is necessary to 

::25^i n t^rpolate...the.jemining (adjacent) display pixels. 

To simplify processing, the interpolation mechanism is 
preferably executed by replicating each accessed data 
value for one or more adjacent pixels, so that each 
respective pixel of image data from the first 
30 partitioned picture region R X S sub-array, is 

initially coupled to a selected plurality (e.g. four) 
of display pixels, thereby rapidly providing the viewer 
with a low resolution image. 

Thereafter, as database read-out continues, 
35 additional partitioned R X S sub-arrays of data 
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entries, associated with pixels whose values were 
originally replicated from the first R X S sub-array 
are accessed, so that successive sub-arrays of 
(replicated) pixel values are iteratively replaced by 
5 actual data values from the database. After a 

plurality (e.g. four) of the R X S sub-arrays are read 
out from database into the playback device, at the CD 
player's (low speed) transfer rate, this successive 
sub-array replacement operation will result in a final 
10 display having an increased resolution image. . 

Embodiments of the present invention will now 
be described, by way of example, with reference to the 
accompanying drawings in which: 

Figure 1 diagrammatically illustrates a 
15 photographic color slide processing system in which the 
present invention may be employed; 

Figure 2 diagrammatically shows a 512 row by 
7 68 column array of image picture elements (pixels) ; 

Figure 3 diagrammatically shows the sub-array 
20 components of an 8 X 8 pixel image; 

Figure 4 diagrammatically illustrates 

- replicating^each -acce^ed.vd'ato~ : valuev€=or^a^piura-lity of 

four adjacent pixels; 

Figures 5, 6 and 7 diagrammatically 

25 illustrate the iterative updating of the output image 

obtained by sequentially accessing the four partitioned 
^^^^ 

Before describing in detail the iteratively 
increased resolution database access and display 

30 mechanism in accordance with the present invention, it 
should be observed that the present invention resides 
primarily in a novel structural combination of 
conventional image processing circuits and components 
and not in the particular detailed configurations 

35 thereof. Accordingly, the structure, control and 
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arrangement of these conventional circuits and 
components have been illustrated in the drawings by 
readily understandable block diagrams which show only 
those specific details that are pertinent to the 

5 present invention, so as not to obscure the disclosure 
with structural details which will be readily apparent 
to those skilled in the art having the benefit of the 
description herein. Thus, the block diagram 
illustrations of the drawings do not necessarily 

10 represent the mechanical structural arrangement of the 
exemplary system, but are primarily intended to 
illustrate the major structural components of the 
system in a convenient functional grouping, whereby the 
present invention may be more readily understood. 

15 Figure 1 diagrammatically illustrates a 

photographic color film processing system in which the 
present invention may be employed. For purposes of the 
present description such a system may be of the type 
described, for example, in co-pending Patent 

20 application Serial Number , filed . 

by S. Kristy, entitled "Multiresolution Digital Imagery 
Photof inishing System, ■ assigned to the assignee of the 
present application and the disclosure of which is 
incorporated herein. However, it should be observed 

25 that the .sys tem descri bed, in the ab o ve- re ferenced co- 
pending application is merely an example of one type of 
system in which the invention may be used and is not to 
be considered limitative of the invention. In general, 
the invention may be incorporated in any digitized 

30 imagery processing system. 

In accordance with the digital image 
processing system of Figure 1, photographic images, 
such as those captured on 35mm negatives 10, are 
scanned by a high resolution opto-electronic film 

35 scanner 12, such as a commercially available Eikonix 
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Model 1435 scanner. Scanner 12 outputs digitally 
encoded data representative of the response of its 
image sensing array onto which the photographic image 
contained on a respective color negative is projected. 
5 This digitally encoded data, or "digitized* image, is 
coupled in the form of an imaging pixel array- 
representative bit map to an attendant image processing 
workstation 14, which contains a frame store and image 
processing application software through which the 

10 digitized image may be processed (e.g. enlarged, 

rotated, cropped, subjected to scene color balance 
correction, etc.) to achieve a desired image 
appearance. Once an image file has been prepared, it 
is written onto a transportable medium, such as an 

15 optical compact disc 16, for subsequent playback by a 
disc player 20 which allows the image to be displayed, 
for example, on a relatively moderate resolution 
consumer television set 22, or printed as a finished 
color print, using a high resolution thermal color 

20 printer 24. 

In accordance with the image processing 
- -system described in th^ 'above - Ref erenced cb-pending 
application, each captured image is stored as a 
respective image data file in the form of a low 

25 resolution image bit map file and a plurality of 

residual images associated with respectively different 

combining 

successive residual images with the low resolution 

image, successively increased resolution images may be 
30 recovered from the low resolution image for application 

to a readout device such as a color video display or 

hard copy printer. 

As an example, the low resolution bit map 

file to which the original high resolution image is 
35 reduced may comprise a 512 row by 768 column array of 
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pixel values, as diagrammatically shown in Figure 2, 
and such that there is substantially a one-for-one 
correspondence between the spatial values of the low 
resolution image array and the pixels of an associated 
5 display, such as the 480 X 640 'square pixel- display 
capability of an NTSC television receiver, where the 
center 480 rows and 64 0 columns of the database pixels 
correspond, one-for-one, with the display pixels. The 
stored 512 row by 7 68 column image is preferably 

10 formatted into a plurality (e.g. four) partitioned sub- 
arrays, respective image locations of which are 
immediately adjacent to one another, so as to form an 
array of contiguous image components. For the example 
of formatting a 512 X 768 array into four partitioned 

15 sub-arrays, the database may be considered to comprise 
a 256 X 384 array of "blocks-of -f our " image components 
1, 2, 3 and 4, several of which are shown in Figure 2. 
In order to simplify the illustrations in the drawings, 
rather than treat the parameters of a 512 X 768 image 

20 array, the discussion to follow will treat an image 
comprised of eight rows Rl. . .R8 and eight columns 
Cl...C8~of image values, as diagrammaticaily shown in 
Figure 3. It should be observed that the example of an 
8X8 image is merely for purposes of simplifying the 

25 description and illustration and, like the 512 X 768 

-----■^^elr^mage^ . referenced above , is not to be considered 
limitative of the invention. 

The 8X8 pixel image of Figure 3 is depicted 
as comprising a 4 X 4 array of partitioned 'blocks-of - 

30 four' image blocks B1...B16, each of which contains 

four adjacent pixels. Image block Bl contains pixels 

i-2, 1-3 and 1-4. Similarly, image block B2 
contains pixels 2-1, 2-2, 2-3 and 2-4, and so on, down 
through block B16, which contains pixels 16-1, 16-2, 

35 16-3 and 16-4. 
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In accordance with the database accessing 
scheme employed by the present invention, during the 
initial read-out of the database, only one of the 
partitioned sub-arrays of pixels (1-1... 1-16) is 
5 accessed for the purpose of regenerating the entire 
image (all four pixels in each of blocks B1...B16). 
Thereafter, the remaining 'replicated* entries of the 
image are successively "f illed-in" with their true 
values, until the image is completed. 

10 More particularly, when a digitized image 

read out by CD player in Figure 1 from compact disc 16 
is to be displayed on video display 22, the first 
partitioned sub-array of pixel values (1-1... 1-16 in 
Figure 3) is transferred to a video framestore resident 

15 in CD player 20. As the first sub-array of pixels is 

transferred and stored in the CD player framestore, the 
framestore is addressed so as to store the respective 
entries of only one of. its low resolution sub-arrays, 
such as 4 X 4 sub-array 1, containing sub-array data 

20 entries 1-1... 1-16. Because the size of the first 
.._„.,- partitioned sub- array is - only a fraction (here , one- 
fourth) of the size of the display array, it is 
necessary to interpolate the remaining (adjacent) 
display pixels. To simplify processing, the 

25 interpolation mechanism is preferably executed by 

- repl-ieat-ing~ each pixel—Value first partitioned 

sub-array for one or more adjacent pixels, as 
diagrammatically illustrated in Figure 4, so that each 
respective pixel of the first partitioned sub- array (1- 

30 1...1-16) is initially coupled to a selected plurality 
(here four) of display pixels, thereby rapidly 
providing the viewer with a low resolution image. In 
terms of the parameters of the 512 X 768 pixel bit- 
mapped image file referenced above and a 480 X 640 

35 pixel display, what is initially displayed is a ■lower - 
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resolution display of 240 X 32 0 independent image data 
values that occupy or 'fill" the overall 480 X 64 0 
pixel matrix of the color display device. While the 
240 X 320 displayed image is not a "high" (e.g. 2048 X 

5 3072) resolution image, or even a low resolution image 
equivalent to the 480 X 640 resolution of the color TV 
monitor,, it has sufficient definition to permit the 
viewer to decide whether to leave the image on the 
screen or to call up another image. 

10 Thereafter, as diagrammatically represented 

by the sequence illustrated in Figures 5, 6 and 7, 
during subsequent reading of the database in accordance 
with the data transfer . rate of the CD player, 
additional partitioned sub-arrays 2, 3 and 4. which 

15 contain the true values of the originally replicated 

pixels in the array of Figure 4, are called up, so that 
successive sub-arrays of replicated pixel values within 
the displayed image are replaced by their true data 
values. Thus, after the plurality (here four) of 

20 partitioned sub-arrays have been read from the database 
. at the. slow.CD data transfer rate, the successive sub- 
array replacement process will result in a finally 
displayed "increased" resolution image. The phrase 
"increased" resolution image is intended to mean an 

25 image whose resolution is greater than that originally 

as shown in Figure 4. For example, in the case of the 
512 X 768 pixel bit-mapped database image, the 
originally displayed image is a 240 X 32.0 pixel image, 

30 while the final "increased" resolution image is a 480 X 
640 pixel image. The "increased" resolution image is 
not necessarily the maximum resolution image available 
after iterative residual processing of the bit -mapped 
image within the original database which provides a 

35 -high" resolution image, for example a 2 048 X 3072 
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pixel image suitable for producing a high quality color 
print . 

As will be appreciated from the foregoing 
description, by rapidly providing the viewer with an 
5 initially relatively low resolution image and 

thereafter iteratively increasing the resolution the 
displayed image, the present invention is. able to 
substantially reduce the considerable ■ viewing delay" 
encountered when accessing a digital image from a 

10 relatively high resolution database using a 

conventional sequential low speed data transfer scheme. 
By presenting the viewer with such a "quick-view" 
image, the present invention enables the viewer to 
determine whether the image being displayed is of 

15 interest, so that the viewer has the immediate option 
of calling up another stored image or permitting the 
currently displayed low resolution image to be 
iteratively enhanced. 

While we have shown and described an 

20 embodiment in accordance with the present invention, it 
is to be understood that the same is not limited 
thereto but is susceptible to numerous changes and 
modifications as known to a 'person skilled in the art, 
and we therefore do not wish to be limited to the 

-2 5 details- shown-and des crlbed--her.ein~but--int end -to cover 

all such changes and modifications as are obvious to 
one of ordinary skill in the art. 
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aims: 

1. For use with an image-representative 
data base, respective data storage locations of which 
contain image data associated with the respective 

5 locations of a two-dimensional M X N array of pixels of 
said image, a method of displaying said image on a 
display device, said display device containing a J X K 
array of picture elements, comprising the steps of: 

(a) accessing, from said image- 

10 representative data base, image data associated with 
selected first sub-array of said M X N array; and 

(b) coupling respective components of 
imagery data accessed in step (a) to a selected first 
sub-array of said J X K array, so that said display 

15 device displays said image at a resolution that is 

reduced by the spatial selectivity of said first sub- 
array of said M X N array. 

2. A method according to claim 1, further 

including the steps of: 
20 (c) subsequently accessing, from said image- 

representative data base, imagery data associated with 
a selected second sub-array of said M X N array; and 

(d) coupling image data accessed in step (c) 
to a selected second sub-array of said J X K, so as to 

displays said image. 

3. A method according to claim 2, wherein 
step (b) comprises coupling the respective values of 
image data associated with said selected first sub- 

30 array of said M X N array accessed in step (a) , to a 
selected plurality of pixels of said J X K array. 

4. A method according to claim 2, further 
including the steps of: 
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(e) accessing, from said image- 
representative data base, image data associated with a ' 
selected third sub-array of said M X N array; and 

(f) coupling image data accessed in step (e) 
5 to selected third sub-array of said J X K array among 

first regions thereof, so as to further increase the 
resolution at which said display device displays said 
image. 

5 . A method according to claim 4 , and 
10 wherein step (b) comprises coupling the respective 
values of image data associated with said selected 
first sub-array of said M X N array accessed in step 
(a) to a selected plurality of first pixels of said 
J X K array. 

15 6. A method according to claim 1, wherein, 

for the J X K array of picture elements of said display 
device, J=M and K=N. 

7. For use with a two-dimensional image- 
representative data base having a plurality of data 

20 entries, each data entry being associated with a 

respective pixel of a two-dimensional array of M X N 
pixels that make up said image, a method of controlling 
the energization of an array of J X K pixels of a 
display device, so that said display device displays a 

25 representation of said image, comprising the steps of: 

, : ... . of 

said data base which are respectively associated with a 
two-dimensional array of R X S pixels of said image and 
the spatial resolution of which is less than that of 

30 said M X N pixels; and 

(b) energizing respective ones of R X S 
pixels of the array of J X K pixels of said display 
device in accordance with respective first selected 
data entries of said data base accessed in step (a) . 

35 
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8. A method according to claim 7, wherein 
the spatial resolution of said array of R X S pixels is 
less than the spatial resolution of said array of J X K 
pixels . 

5 9. A method according to claim 7, wherein 

step (b) comprises coupling a respective image data 
value associated with a respective pixels of said set 
of first pixels of said R X S array accessed in step 
(a) , to a selected plurality of pixels said J X K 
10 array- 

10. A method according to claim 7, further 

including the steps of: 

(c) accessing a second set of data entries 
of said data base which are respectively associated 

15 with a two-dimensional array of P X Q pixels of said 

image and the spatial resolution of which is less than, 
that of said M X N pixels; and 

(d) energizing respective ones of P X Q 
pixels of the array of J X K pixels of said display 

20 device in accordance with a respective second set of 
data entries of said data base accessed in step (c) . 

11. A method according to claim 10, further 
including the steps of: 

(e) accessing a third set of data entries of 
:^S™ wta^afce^&se-which-are; respect ively . .associated with a 

two-dimensional array of C X D pixels of said image and 
the spatial resolution of which is less than that of 
said M X N pixels; and 

(f ) energizing respective ones of C X D 
30 pixels of the array of J X K pixels of said display 

device in accordance with a respective third set of 
data entries of said data base accessed in step (e) - 

12. For use with a two-dimensional image- 
representative data base having a plurality of data 

35 entries, each data entry being associated with a 
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respective picture region of a two-dimensional array of 
M X N picture regions that make up said image, a method 
of controlling the energization of an array of M X N 
pixels of a display device, so that said display device 
5 displays a representation of * said image comprising the 
steps of: 

(a) accessing first selected data entries of 
said data base which are respectively associated with a 
two-dimensional array of R X S picture regions of said 

10 image and the spatial resolution of wfiich is less than 
that of said M X N picture regions; and 

(b) energizing respective ones of R X S 
pixels of the array of M X N pixels of said display 
device in accordance with respective first selected 

15 data, entries of said data base accessed in step (a). 

13. A method according to claim 12, wherein 
step (b) comprises coupling a respective component of 
imagery data, associated with a respective one of said 
selected first picture regions of said R X S array 

20 accessed in step (a), to a selected plurality of first 
picture elements of said M X N array* 

14. A method according to claim 13, further 
including the steps of: 

(c) accessing second selected data entries 
25 of said data base which are respectively associated 

. . with-a r: tw - 
of said image and the spatial resolution of which is 
less than that of said M X N picture regions; and 

(d) energizing respective ones of P X Q 
30 pixels of the array of M X N pixels of said display 

device in accordance with respective second selected 
data entries of said data base accessed in step (c) . 

15. A method according to claim 14, further 
including the steps of: 



35 
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(e) accessing third selected data entries of 
said data base which are respectively associated with a 
two-dimensional array of C X D picture regions of said 
image and the spatial resolution of which is less than 

5 that of said M X N picture elements; and 

(f ) energizing respective ones of C X D 
pixels of the array of M X N pixels of said display 
device in accordance with respective third selected 
data entries of said data base accessed in step (e) . 

10 16. A method according to claim 15,. further 

including the steps of: 

(g) accessing fourth selected data entries 
of said data base which are respectively associated 
with a two-dimensional array of J X K picture regions 

15 of said image and the spatial resolution of which is 
less than that of said M X N picture elements; and 

(h) energizing respective ones of J X K 
pixels of the array of M X N pixels of said display 
device in accordance with respective fourth selected 

20 data entries of said data base accessed in step (g) • 
17. For use with a two-dimensional image- 
representative data base having a plurality of data 
entries, each data entry being associated with a 
respective picture region of a two-dimensional array of 
■ -25;— said..,image , a method 
of controlling the energization of an array of M X N 
pixels of a display device, so that said display device 
displays a representation of said image comprising the 
steps of: 

30 (a) accessing first selected data entries of 

said data base which are respectively associated with a 
two-dimensional sub-array of R X S picture regions 
distributed among the M X N picture regions of said 
image, such that the spatial resolution of said R X S 

35 picture regions is less than that of said M X N picture 
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regions; and 

(b) energizing respective ones of an R X S 
sub-array of pixels of the array of M X N pixels of 
said display device in accordance with respective first 

5 selected data entries of said data base accessed in 
step (a) . 

18. A method according to claim 17, wherein 
step (b) comprises coupling a respective component of 
imagery data, associated with a respective one of said 

10 selected first picture regions of said R X S sub-array 
accessed in step (a) , to a selected plurality of first 
picture elements of said M X N array. 

19. A method according to claim 18, wherein 
the number of first picture elements of said selected 

15 plurality corresponds to the ratio of M X N picture 
elements to R X S picture elements. 

20. A method according to claim 19, further 
including the steps of: 

(c) accessing second selected data entries 
20 of said data base which are respectively associated 

With a two-dimensional sub- array of P X Q picture 
regions distributed among the M X N picture regions of 
said image, such that the spatial resolution of said 
p X Q picture regions is less than that of said M X N 
25 pictu re regions; and 

(d) energizing respective ones of a sub- 
array of P X Q pixels distributed among the array of 

M X N pixels of said display device in accordance with 
respective second selected data entries of said data 
30 base accessed in step (c) • 

21. A method according to claim 20, further 
including the steps of: 

(e) accessing third selected data entries of 
said data base which are respectively associated with a 

35 two-dimensional sub-array of C X D picture regions of 
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said image distributed among the M X N picture regions 
of said image, such that the spatial resolution of said 
C X D picture regions is less than that of said M X N 
picture regions; and 
5 (f) energizing respective ones of a sub- 

array of C X D pixels distributed among the array of 
M X N pixels of said display device in accordance with 
respective third selected data entries of said data 
base accessed in step (e) . 
10 22. A method according to claim 21, further 

including the steps of: 

(g) accessing fourth selected data entries 
of said data base which are respectively associated . 
with a two-dimensional sub-array of J X K picture 

15 regions of said image distributed among the M X N 

picture regions of said image, such that the spatial 
resolution of said J X K picture regions is less than 
that of said M X N picture regions; and 

(h) energizing respective ones of a J X K 
20 sub-array of pixels distributed among the array of 

M X N pixels of said display device in accordance with 
respective fourth selected data entries of said data 
base accessed in step (g) . 
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